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1. Introduction 

The Total Quality Philosophy had its start in the Navy in 1 985. Ten years later, this 
philosophy has stalled in the middle management area of the workplace. These managers 
know how to repair broken machineiy or design facilities, but lack the management skills 
necessary' to lead and encourage the workforce they manage into the next century. 

A few years ago, Cominander-in-Chief, US Atlantic Fleet, (CINCLANTFLT) created 
a metrics program (DON 1996) to better understand the operations of the various bases. 

(The Navy has had a similar program for operational ships for decades, but shore 
establishments were excluded due to the various complexities and diverse locations.) As the 
Navy developed this program, requests for data went out to the individual bases for input. 

The underlying problem in the whole process was that the ^'experts" in the metrics operations 
did not fully understand the type of business the various commands performed throughout 
the world. They even asked the base operators for “data that would make for a good metric." 
Since the process owners had no understanding of what made for a good metric, the>- were 
unable to fulfill the requirements to produce satisfactory' results. 

Public Works Iceland has collected data over the years concerning several issues, but 
middle management simply collected data and sent this information up the chain of 
command to the Public Works Officer. The workforce never saw the data, knew what the 
data said, or saw the outcome of the report. As an example, the workforce is required to 
submit their annual leave plan in an effort to ensure a sufficient workforce at any time. This 
infonnation is used to schedule the work hours for the year. Data are collected to compare 
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the actual leave with the scheduled leave and compare this to the production cycle. This 
report is sent up the chain of command, but the workforce does not see this report or 
understand the relationship between scheduled and actual lea\ e. Keeping the workers 
informed about overall productivity and the meaning of the measured data is the 
responsibility of the middle managers. Indeed, making sure that the right data are collected 
is also management's responsibility. 



1.1 Scope 

A successful manager's job is not as a drill sergeant barking orders to his platoon, but 
as a coach coordinating his players’ actions to become more successful. A manager must 
provide for the needs of his people: direction, knowledge, resources, and support {Byham 
1988 ). 

• Direction is provided by establishing key result areas, goals and measurements. 

• Knowledge invoh es needed job skills, technical training, data, information, 
expertise. 

• Resources required for a successful team performance include tools, materials, 
facilities, time and money. 

• Support is the foundation and catalyst for the team — approval, encouragement, 
feedback, reinforcement, recognition 

Much has been written concerning these four areas. The scope of this paper is to 
focus on the ^‘direction" area by analyzing the metrics at the Public Works Department 
(PWD), Keflavik Iceland. Metrics provide the direction needed for growth by identifying 
key result areas, measurements, and goals. Key result areas address the direction an 
organization wishes to go. Measurement is a way of knowing if the organization is mo\ing 
in the right direction in terms of the key result areas. Finally, the goals pro\ ide for a level of 
achievement or set a standard to reach for. 
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Before Key Result Areas can be established, an understanding of the organization's 
processes is vital, A useful tool in this analysis is the SIPOC diagram. SIPOC stands for 
Supplier - Input - Process - Output - Customer. Suppliers are the individuals or other 
organizations that provide an input or supplies for the processes. The customers are the 
individuals or organizations that use the output generated by the processes. Figure 1 shows 
an example of a simple SIPOC diagram for one area of PWD Keflavik. SIPOCs for the 
entire PWD Keflavik are given in Appendix A and discussed further in Chapter 3. 



Supplier Process Customer 




Figure I - SIPOC Diagram 



1.2 Objectives 

The objectives of this report are as follows: 

1 . Develop SIPOC diagrams for PWD Keflavik 

2. Capture the existing measures and reporting techniques at PWD Keflavik. 

3. Analyze the measures for viability. 

4. Develop a list of viable metrics (Remo\ e the measures that are unnecessary' and add 
any that are necessaiy^ for PWD Keflavik.) 

5. Develop a training plan for the PWD Keflavik workers in the data gathering and 
reporting of the metrics. 
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2. Background 



2.1 Mission of Public Works 

Throughout the Na\y, Public Works Departments are tasked with maintaining the 
shore facilities that support the world-wide fleet. Without such support, the ships and planes 
that project America’s presence to the far reaches of the world would be impossible. PWDs 
var\’ in size from small units where the maintenance force is composed of civ ilian contracted 
labor to large departments made up of government civilian and militar>' labor. Regardless of 
size, the basic mission of PWDs is to provide public works services to the bases and its 
operating commands. These services include facility maintenance, utilities, transportation 
ser\ ice. engineering support, and environmental serv ices. 

2.1.1 Size 

Public Works Department, Kefla\ ik is composed of military forces along with both 
US and Icelandic civ ilian personnel. The department is composed of six militarv' officers, 58 
enlisted, five US civ ilians and 260 Icelandic civ ilians. Typical dutv' length for the militarv is 
1.5 years (unaccompanied) to 2.5 years (accompanied). Due to the frequency of the rotating 
positions, the Icelanders pro\ ide a continuation to the ov erall direction of Public Works. 
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Public Works' basic functions are shown in figure 2 and can be broken into two 
categories: support and operational. The support comes in the font! of engineering, planning, 
and administrative assistance. Contracting and environmental divisions provide both support 
and operational duties. The operational backbone of the PWD is the maintenance, utility, and 
transportation di\ isions. These divisions are composed of Icelandic civilians and augmented 
with the enlisted militar>' personnel. They perform duties ranging from minor repairs and 
preventive maintenance, to major renovations of facilities. In addition, they operate and 
maintain the base power plant, water plant and all government vehicles on base. 



FacilitN' Maintenance 



Transportation 




Utilities 



Public Works Officer 

Engineering Assistant PWO Contracting 

Shops Engineer 




Planning 




Environmental 



Admin Support 



Figure 2 - Public IVorks Organization 



2.1.2 Location 

Iceland is located just south of the Arctic Circle in the Atlantic Ocean (figure 3). 
Naval Air Station Keflavik lies on the southwest corner of Iceland which makes for some 
unique problems. A harsh environment coupled with a unique terrain present a tremendous 
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challenge to maintain a fully operational base. Low temperatures, high winds, combined 
w'ith rain and snow, provide a new definition of a “challenging environment." 

2.2 Why Measure? 

“Why measure?" is perhaps the most common question asked by management when 
addressing the subject of metrics. The answer resides in the fact that items that are measured 
are items that see improvement over time. The realm of measuring comprises many facets 
and is possibly overwhelming for some. An understanding into the basics of measurements 
is the first stage of de\ eloping a successful program. 

2.2.1 Types of measurements 

Measurements can be broken into three classes: anecdotal, subjecti\’e, and objective. 
Anecdotal information is that which comes from one source or one person’s opinion. 
Depending on the indi\ idual experience, the rating might be favorable or unfavorable. 
Subjective measurements also contain personal feelings but are from a larger source of 
information. These might be in the form of opinion polls, surv eys, and questionnaires. 
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Objective measurements are the most accurate fonn of information since they are not 
affected by personal feelings or prejudices. These measurements are based on facts and, if 
done correctly, are unbiased. The difficulty most managers have in using measurements is 
their desire to use objecti\ e data, but subsequently reacting to anecdotal statements from 
their boss or customers. 

2.2.2 Types of performance measures 

Performance measures rely on the objective class of measurements. Since objectiv e 
data are not based on personal feelings or prejudices, a realistic picture of the operation is 
possible. Research into measurements has developed some lengthy lists, but most 
performance measures can be broken into four types (Ammons 1995): 

• Workload measures 

• Efficiency measures 

• Effectiveness measures 

• Productivity measures 

Workload measures indicate the amount of work performed or the amount of ser\ ices 
received by the customer. Examples of workload measurements include number of service 
calls received, amount of estimates completed, amount of design work completed. While 
this type of measurement is useful to detennine the amount of work done, it does not show 
efficiency or effectiveness. 

Efficiency measures illustrate the relationship between the work performed and the 
resources required to perform it. Most efficiency measurements are presented as unit costs. 
Unit costs are calculated by dividing total costs of a serv^ice or function by the number of 
units provided For example, if a 200 meter underground electrical line is installed for a cost 
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of S50,000. The unit cost is $250/meter. Similar costs can be calculated for engineering 
design, estimates, transportation repairs, and various other functions within a PWD. When 
these costs are compared to past performance or unit costs by contracting, wise decisions can 
be made when allocating resources. 

Effectiveness measures reflect the degree to which performance objectives are being 
achieved or reflect the quality of the organization's performance. The number of work hours 
spent on construction re-work or error free engineering designs are e.xamples of 
effectiveness measures. 

Productiviu measures combine the dimensions of efficiency and effectiveness into a 
single indicator. For example, ''time spent on a maintenance service call" would measure 
efficiency and "percentage serv ice calls completed properly" (i.e., not called back for the 
same problem) would reflect effectiveness. "Labor-hours per effective service call 
completion" would indicate productiv ity. 

2.2.3 Attributes of good metrics 

Developing a set of metrics is a fairly simple task. Developing a set of useful metrics 
is the difficult part. Too often managers trv' to improve their organization by creating new 
measures to report The weakness in this approach comes from not fully understanding the 
qualities that make up a quality metric. The following list attempts to prov ide a framework 
or guideline for managers when deciding what and how to measure their processes (Tucker 
1997). Successful metrics must. 

• Be accepted as meaningful to the customer 

• Tell how well an organization’s processes and tasks fulfill its goals and objectives 

• Be simple, understandable, logical and repeatable 
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• Be timely 

• Show a trend 

• Be clearly defined 

• Be economical to collect the data 

• Drive the appropriate action 

2.2.4 Overcoming resistance to performance measurement 

Even if all these criteria are met, people will still resist perfonnance measurement. 

Performance measurement is seen as a threat by \ arious groups in an organization. Middle 

management might feel threatened as the upper levels of management get a closer look into 

their ‘"sacred" operations. Employees feel that measuring will lead to tougher work 

standards and less fa\ orable working conditions and perhaps even layoffs. Even with the 

best programs and most accurate set of measurements, overcoming resistance by employees 

is still a factor to consider. David Ammons ( 1 995) mentions se\ eral reasons people resist 

measurement; 



♦ ""You can't measure what I do" 

♦ ""You're measuring the wrong thing" 

♦ "‘It costs too much and we don't have the resources'’ 

♦ “I don't want to know how I am doing" 

2,2,4 J Impossible to Measure - can V measure what / do^' 

Di\’isions where w ork is of a non-routine nature and a data collection system does not 

exist will complain the loudest at performance measurement. They have sur\ ived this long 

without measuring, w^hy start now? If the division could be measured, a system would 

already be in place. A starting place for detennining what areas to measure lies in the 

answer to the question: "‘If your office closed shop for a few' weeks, who would suffer the 

greatest impact, and w'hat aspect of your work w ould they miss the most'!^" With this answ er, 

acceptable performance measures can be easily developed. 
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2,2,4»2 Incorrect Measures - '"You 're measuring the wrong thing" 

This argument usually is heard when the service providers are not consulted prior to 

developing performance measures. Insignificant indicators are being measured and more 

important dimensions are ignored. Communication between all levels in the organization is 

critical to ensure measurements are valid and that every^one understands the reasons behind 

the measurements. 

2.2,43 Collection Economy - "'It costs too much and we don 't have the resources" 
Economy of the data collection and the time required to collect and report are 

fundamental to a successful metric. Sex eral companies have spent more effort and money 

collecting data than the money they have saved by using the results (Ammons 1995). 

2.2. 4.4 Ostrich Management - "I don V want to know how I am doing" 

Some managers simply do not care or do not want to know how their operations are 

perfonning. They have the ‘‘See no evil, Hear no evil, Speak no evil" mindset and hope that 

by burying their head in the ground, all bad problems will disappear. These managers must 

be able to see the results of a measurement system before solid changes can take place. 

2.3 Current Training 

Currently PWD Kefla\ ik is not training personnel on subject matter related to 
measurements of quality' initiatix es. Several years ago, PWD Keflavik began a push to 
educate personnel on the aspects of Total Quality Management. People attended training, 
but there was no plan for practicing the concepts learned in the classes when they returned to 
work. Recently PWD Keflavik has begun to develop a long range plan for the department 
and is utilizing teams to research the options available. Through the use of teams, the PWD 
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is seeing improvements, but this improvement is restricted due to insufficient training for the 
teams. More successful teams are ones that have a leader with a strong background and 
interest in TQ tools and techniques. 

Peter Scholtes describes the four phases of team growth (forming, storming, norming, 
and perfonning) in The Team Handbook (Scholtes 1988). Unprepared teams frequenth 
ne\er make it past the storming stage in team growth. When the stonn arrives, the\ abandon 
the ship, call the event a failure, and return to their old way of doing things. Successful 
teams mo\e beyond the stage and e\entually reach the performing stage with outstanding 
results. Metrics pro\ ide a sound basis for a successful team en\ ironment. 
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3. Methodology 

In order to evaluate PWD Kellax ik and develop meaningful metrics, the following 
methodologv' was used in this study. 

3.1 Capture Existing Metrics 

A two week site visit was conducted in May 1 997 to examine the state of 
measurements at PWD Keflavik. One-on-one interviews were conducted with all nine 
division managers to understand the complexit>- of their organization. The interv iews 
followed a basic pattern focused on using the SIPOC diagram as the foundation. This first 
step in the interview allowed each manager to clearly focus on what their division actuallv 
did before trv ing to address any measurement techniques. Understanding this process is the 
first step to improvement, with the second being process measurement. Appendix A contains 
SIPOC Diagrams for all nine divisions. 

After the SIPOC was complete, a review of current measurements of conducted 
Each interviewee was asked; Are they currently conducting any measurements? Have they 
seen a trend over the past year? Has there been an increase or decrease in the process time‘^ 
Many of these questions were unanswerable since measurements did not exist. The few* 
managers who still collected data either were not reporting to an\ one or did not fully 
understand how to analyze the data generated to make future management decisions. These 
existing measurements were discussed to improv e the method of presentation and anah sis 
along with providing for a structured approach to measurement. 
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3.2 Review Required Metrics 

While no fonnal metrics methodolog>' exist for PWD Keflavik internally, se\ eral 
divisions do measure portions of their operations. Without a fonnal structure or requirement, 
the validitv' is questionable at best. In May of 1996, CINCLANTFLT developed a metrics 
program for shore installations called CINCLANTFLT Shore Installation Required 
Operational Capabilities Metrics. The external requirements have been in place for over a 
year now, but their use is ineffective for the PWD. These metrics are used at the 
CINCLANTFLT level to compare bases to each other, but the local bases are unable to use 
the infonnation effectively since the delay in providing feedback from CINCLANTFLT to 
the local bases is excessive. Along with delayed feedback is the constantly changing 
political nature of the program without providing information to the providers of 
information. The latest change is the name of the program from “Metrics" to “Measures of 
Merit.’’ 

3.3 Develop Common Metrics 

Since the metrics program for CINCLANTFLT fails to provide adequate feedback on 
operations for PWD Keflavik, improvement of existing measurements and development of 
new measurements is essential. Actual data from previous years was gathered to develop 
several new metrics. These data were discussed with the division directors to clarify the 
accuracy and create an understanding into the process. In an effort to normalize all the 
metrics between divisions, Tables of Standards (appendix B) were developed for each metric 
to provide a framework common to all measurements within Public Works. 
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4. Data Presentation and Analysis 

SIPOC‘s developed for all nine divisions show the input and output to each process 
within the division. From process review of the SlPOC‘s, metrics were de\ eloped to 
measure the capability of the process . Existing metrics were refined and new metrics were 
created to develop an accurate presentation of the operations at PWD Keflavik. 

4.1 SIPOC 

Figure 4 shows a SIPOC diagram for the maintenance division of PWD Keflavik. As 
an example, one of Maintenance's processes is emergency and serxnce calls. Base personnel 
submit trouble calls to PWD via the trouble desk. The input received by Maintenance is in 
the form of a printed work order (or phone call if on an emergency nature.) The other input 
Maintenance receives is material that comes from the Material Branch of PWD Keflavik. 
The output comes in the form of a repair to the broken item which satisfies the customer 
(Base personnel.) 
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f igure 4 - Example SIP()(\for the Mawienaiice Divisum of PWI) Keflavik 



Table 1 provides reference for all the SIPOC diagrams located in Appendix A. The 
SIPOC's are broken down by PWD Keflavik Divisions. SIPOC Diagrams ha\ e multiple uses 
within an organization. Perhaps the most used application is improvement of processes. 
Many organizations focus on process improvement, but do not have a clear understanding of 
their processes. SIPOC defines these processes and forces the owners to set boundaries of 
these processes. These boundaries are the ranges of customers and suppliers along w ith 
inputs received and output generated. 
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The second use is to capture metrics. Measuring a process that is not related to an 



organization’s processes is a waste of valuable resources. Metrics must somehow be a 
reflection of the SIPOC. For example, the Maintenance Division measures ‘leave 
predictability/’ This is not a processes itself, but it an indicator of all their processes since 
available labor is essential to their processes. 

Communications breakdown can be avoided with quality SIPOC diagrams. Through 
the use of these accurate diagrams, various members of the organization can see where they 
fit into the roles as supplier and customer. 

Lastly, the SIPOC’s included can be further broken down to provide the level of 
detail necessary for the organization. They should also be updated regularly as processes and 
situations change. For example, pest control responsibility transferred from the Maintenance 
division to the Environmental division. Detail SIPOC diagrams should reflect these changes 
to a\'oid portraying an inaccurate picture of the organization. 



Table 1 - SIPCX' location in report 



Division Code 
601 - Fiscal Personnel 



SIPOC Location 
Figure A. 1 



602 - Facilities Management Engineering Figure A. 2 



603 - Engineering 

604 - Planning 

605 - Maintenance 

606 - Utilities 

607 - Transportation 

608 - Contracting 
60E - Environmental 



Figure A. 3 
Figure A.4 
Figure A. 5 
Figure A. 6 
Figure A. 7 
Figure A. 8 
Figure 
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4.2 Metrics 



Appendix B shows a complete list of metrics with their breakdown of standards. 
These standards provide for a nonnalization for all metrics. This approach attempts to 
eliminate irrelevant, non-cost effective measures and fonnally recognize those that are 
relevant. (Oswald 1992). Individual metrics are analyzed to include the following: 



• Definition of what is being measured 

• Justification for the measurement, including key result areas supported 

• Description of all terms involved in the measure and units 

• Sources of data 

• Data presentation method, including chart t\ pe. software used 

• Update cycle 

• Responsibility for data collection, plotting analysis 

• Distribution of updated charts 

• Highest level of review' 

• Who is responsible for taking necessary control action 

• Comments & summary 

4.3 Refinement of Metrics 

Keeping in mind the requirements for successful metrics, Table 2 pro\ ides reference 
for the PWD Keflavik metrics. Due to the number of metrics. Appendix B is divided into 
nine sections to correspond w’ith the PWD divisions. Most metrics listed in Table 2 are self- 
explanatory or are a refinement of the existing measurement at PWD Keflavik. However, 
some require additional explanation since they are new to the system. 
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Table 2 - List of valid metrics for PWD Keflavik 



Division Code 


Metric 


l.ocufion 


601 - Fiscal Personnel 




Work Year Utilization 


Figure B 1 1 




End Strength Utilization 


Figure B1 2 




PWT) Toll Costs 


Figure B1 3 




PWT) Overtime Utilization 


Figure B 1 4 




OPTARPl 


Figure B 1 5 


602 - Facilities Management Engineering 






Long Range Plan - Investment Categories 


Figure B2 1 




Customer Breakdown 


Figure B2 2 




Variance Report (Delay causes) ♦ 


Figure B2.3 


603 - Engineering 




Design Effort Efficiency * 


Figure B3 1 


604 • Planning 




Special Projects ♦ 


Figure B4 1 




Space Utilization 


Table B4 2 


605 - Maintenance 




Shop Loading Predictability 


Figure B5 1 




Priority Job Impact on Shop Load Plan 


Figure B5 2 




Effect of leave planning on Shop Load Plan 


Figure B5 3 




In-House Shop Forces Efficiency- 


Figure B5 4 




Foreman Delay Study 


Figure B5 5 




Ser\'ice calls completion time * 


Figure B5 6 




Serv ice calls backlog * 


Figure B5 7 




Number of jobs using MS Project ♦ 


Figure B5 8 


606 - Utilities 




Electricity Use 


Figure B6 1 




Water Use 


Figure B6 2 




Geothermal Use 


Figure B6 3 


607 - Transportation 




Total Down Time ♦ 


Figure B7 1 




Vehicle Turn-around time 


Fiizure B7 2 


608 - Contracting 




Invoice turn-around time ♦ 


Figure B8 1 




Contractor Performance Evaluation (annual) 


TaWe B8 2 




Customer Satisfaction 


Table B8.3 




Procurement Action Lead Time 


Table B8 4 


60E - Environmental 




Hazardous Waste response time for pick-up * 


Figure B9 1 




Spill response time ♦ 


Figure B9 2 




Construction Review * 

(number of revievv/time for reviews) 
Water Quality Sample Collection 


Figure B9 3 




(time sample received, collected / consistency in sample 
sites / customer sat) 


Table B9 4 


* Hypothetical Data - 


charts show n do not reflect real conditions 
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Work Delay Study - This measurement should be conducted monthI\ by surveying 
the foremen one day.'week or for one week^month. After the data are collected and compiled 
into a summary' report format, improvements can begin in areas that cause a considerable 
amount of delay for the shops. 

Shop Load Variance Delay - There are inevitable delays each month from the shop 
load plan. Understanding the reasons for delays is the beginning of improvement. Before 
the monthly Variance meeting, calculation of the percentages of delay by category’ (W - 
weather, L - labor availability (lack oO, M - material, U - unforeseen conditions, S - customer 
change in scope, C - customer caused delay, O - other). Comparison of these percentages 
over the year will clearl>' reveal the areas w^here improvements can begin. 

En^!ineerin^ Efficiency - The engineering di\'ision accurately tracks hours spent on 
every- aspect of engineering. Using this information to develop the unit costs for design w ork 
w ill allow them to benchmark their costs of work with private contractors. 

Planning Efficiency - Simply measuring the number of estimates generated w ill not 
indicate the efficiency of the planning division. The unit measure (hours/estimate) will 
provide a better picture of the efficiency of the division personnel. Tracking of personnel 
hours (similar to the FMED and Engineering Division) will enable further development of 
effective measures for the planning division. 

Vehicle Dowm-time - PC Transport software does not accurately calculate the 
downtime of vehicles. It is recommended to develop a meaningful measurement to 
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accurately show vehicle dowTitime for various \ ehicle categories. Another recommendation 
is to develop a similar measurement for vehicle turn-around time. 

Customer Satisfaction for contracted work - Management should develop a short 
series of questions to ask random customers about the ser\ ice they receive from contracted 
work. The information can then be compiled into a meaningful presentation. This 
qualitati\ e measurement will provide additional insight into the regular inspections 

Procurement Action Lead Time » The Contracting Officer and Contract Specialist 
should develop a schedule for procurement actions based on best available data. These 
actual dates for important milestones should then be tracked and compared with original 
schedule dates. An analysis is necessary' to determine if actions are meeting anticipated 
target dates or if many actions are slipping and delaying the overall project. (Consult with 
Maintenance Dix ision for help in using MS Project software to develop and use schedules for 
procurement items.) 

4.4 Specific Findings 

Two specific findings are discussed below concerning scheduling of shop forces. 
These findings are based on the data from the Actual Shop Load Plan from October 1995 to 
April 1997. These results are \ alid due to the fact they are based on objective data and cover 
a sufficient time period. Improving the conclusions is possible by monitoring and collecting 
additional data over the future time period. 

Figure 5 shown below demonstrates the correlation of percentage available work- 
hours scheduled with percentage of shop load plan hours w orked. A linear regression 
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indicates that the higher the percentage the plan is loaded, the less chance of meeting the 
plan is guaranteed. Using the actual past data, management must detennine what ‘'percent 
accomplished" they are satisfied with and schedule accordingly. If management wants a 
target of 95% accomplished, data indicates loading the plan to 80% of the available hours. If 
they desire to have the plan accomplished to 80%, then load the plan at 92% of available 
hours. Meeting the scheduled plan is desired since delays or jobs not worked must fall back 
to the next month and will have a ripple effect on numerous other jobs. 



1CX)% - 



90 % ♦ ~ 



80 % - 
sS 

§ 

o 

70 % - 



Shop Loading Predictability 




60 % - 



50 % 

80 % 82 % 84 % 86 % 88 % 90 % 92 % 94 % 96 % 

Shop Loading % 



figure 5 - Example of Shop Loading Prediaahihty 



The other important factor of shop load scheduling is the amount of hours spent on 
Prioritv' Jobs. This chart is shown below in Figure 6. Data from the previous two years 
indicates that an average of 250 work hours per month are spent on priority jobs that were 
not originalh on the Shop Load Plan. These numbers should be taken into consideration 
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when scheduling the monthly work Ignoring the hours will not make the conditions 
disappear, but will only cause the jobs originally scheduled to be delayed. This ripple effect 
not only makes the scheduler's job more difficult, but causes customer incon\ enience and 
irritation when their jobs are delayed. 




The PWD Divisions should review their individual sections and impro\ e upon the 
baseline presented here. Updating the SIPOC diagrams as processes change is vital in 
showing an accurate picture of the work within the divisions. The metrics presented are a 
starting point in understanding how to manage the future by using data from the past. The 
charts must be updated and reviewed continually if they are to be of any use. Training of 
personnel involved in the updating process is critical for continued improvement within the 
department. 



22 



5. Training 

For the preceding metrics to become ingrained into the normal operations at PWD 
Keflavik, individuals must be trained in the use and knowledge of metrics. With the closing 
of the Qualih Resource Center in Keflavik, PWD must develop its own in-house training 
course for the employees invok ed in the measuring process Table three lists the important 
features to be included in a training plan. 



Table 3 - Trowing Course Schedule 



Topics 


Attendees 


Length 


Brief review' of TQM TQL principles 
Introduction to measuring techniques 
Measuring strategies 

Quality Tools (decision making) - 
Brainstorming, Tree diagram, 
SIPOC, Cause & Effect diagram 

Process Measuring Tools - Check sheet. 
Run chart. Control chart. Histogram, 
Scatter plot 


Assistant Division Directors 

An\’ employee who will 
create and update charts 


2 days 



Brief re\ iew of TQM TQL principles 
Over\ iew of Process measuring tools 
Data analysis 

Planning through use of measurements 


Division Directors 


I da\- 


Suggested Sources for information: 



The Team Handbook (Scholtes 1988) 

The Memory' Jogger Plus-^ (Brassard 1989) 

The Memory' Jo^^er II (Brassard 1994) 

Process Improvement Tools & Techniques (DON, no date) 
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One aspect of the training involves constructing control charts. Control charts exist 
in many forms for different types of data. The “Individuals with a Moving Range'* chart is 
the best format for measuring the t> pe of work within Public Works Department since the 
data accumulates rather slowly and it is unable to be sub-grouped. Another adx antage is that 
the individual charts are not sensitive to small shifts in the process average. The Memor\ 
Joeaer IK published by GOAL QPC provides excellent infonnation on constructing control 
charts. Figure 6 shows an example of a control chart. 

Various other chart t>pes are shown in Appendix B. A scatter plot with a regression 
line is shown in Figure 5. A Histogram indicating a breakdown by various customers is 
shown m Figure B2.2. Figure B4. 1 pro\ ides an example of a run chart. After more values 
are collected* control limits can be established and it can be converted into a control chart 
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6. Conclusions & Recommendations 



6.1 Conclusions 

SIPOC diagrams for all nine divisions at PWD Kef1a\ ik were developed to prov ide an 
overall picture of the processes within the department. From these initial diagrams, metrics 
that met the criteria for successful metrics were created to measure the processes. 

Through the use of the metrics and actual data gathered, interesting results were 
found concerning the scheduling of the maintenance shop forces. These results show how 
measurement tools must be used as a management tool for planning the future. Using the 
results as simply a history' record is the same as riding a horse backwards: you have no idea 
where you are going, but you know exactlv w here you have been. Many hours were spent 
developing these metrics and it is management's task to use the infonnation within their 
organization to continually improve their performance. 

6.2 Recommendations 

For any measurement program to have a chance of surv ival, it must be flexible and 
useable. Charts that hang on a wall and yellowed from age indicate management does not 
care and just simply went through the motions. With management firmly behind the 
program, the chances of success increase exponentially. Six recommendations for a 
successful program are: 

Anticipate resistance - as with any change, there will always be individuals who fight 
It. Most of the resistance comes from ignorance of the new system and familiarity with the 
old. 
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Involve employees in developing the correct measures - one step in reducing 
resistance is to actively involve employees in developing the correct measures. Train them 
in data collection and analysis, (i.e., let them create the charts.) It is their process and they 
should have control of it. 

Do both quantitati\ e and qualitative analysis - Focusing onl\ on quantitative 
measures can lead to erroneous mistakes, especially if the numbers are gamed or 
manipulated to make the organization look better. Along w ith focusing on numbers, add 
qualitati\ e measures involving customer satisfaction. Talking with customers and employees 
adds additional insight to the organization's processes. 

Subject measures to annual review and modification - Every year review’ the existing 
measures to determine the adequacy of the reporting technique. The decision should be 
made to keep as is. modify, or delete the measurement. 

Do not use too many or too few measures - During the re\ iew process, care should be 
taken to ensure the right measures are used. Too few will not allow' insight into the 
processes while too many will detract from the important issues. 

Focus on maximizing the use of performance data - Good measurements do not 
guarantee successful management. Only when the managers integrate the results into their 
management style w ill the chance of improvement result. Managers must understand the 
importance of using measurements in forw ard-looking management w'hen planning work, 
budgets, and reward systems. 
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Re\ iewing these six points will help a PWD's metrics program sur\ ive and grow 
through the years. Without these, the program will die after only one or two years. 
Consistent application of objective data to major decisions through the use of metrics w ill 
ensure PWT> will continue to grow and improve its service to its internal and external 
customers. 
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Appendix A - SIPOC Diagrams 
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Base Customers Request for assistance Self-help Authorization ■ Self-help shop 

Shops, comptroller, P&E , $$$, hours , Analysis & productivity , Variance report, F.PS report | PVVO 

Figure A. 2 - SIPOC Diagram for Facilities Management Kngiiieering Division 
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603 - Engineering 
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607 - Transportation 
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608 - Facility Support Contracts 
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Figure A. 9 - SIPOC ni;ignnii for Kiivironnieiital Division 
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Appendix B1 



- Fiscal/Personnel Division Metrics 
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Table Bl.l - \\ork Year Utilization 



Metric 


Work Year Utilization 


Definition of what is being measured 


Measure of staffing levels at PW^D Work years set 


and in what units of measure 


by Comptroller 


Justification for the measurement. Key 
result areas supported 


Resource Utilization 


Description. Definition of all terms 


W'ork Y'ear - One person working for One year at 


involved in the measure 


PWD 


Sources of data 


Comptroller 


Data presentation method. Chart type, 


Run Chart 


software used 


Excel 


Update cycle 


Monthly 


Responsibility for data collection, 
plotting analysis 


Financial Manager 


Distribution of updated charts 


PVVO APW O 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Administrative Officer 


Comments and summary; 


Under - indicates staffing below target, ability to hire 
more employees 

Over ‘ indicates staffing above target and will result 
in o\ er commitment at end of fiscal year unless 
corrective action is taken 
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Work Year Utilization 
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Figure B1.1 - Example of Work Years Tracking 



Table B1.2 - End Strength 



Metric 


End Strength 


Definition of what is being measured 


End strength (number of people employed in Public 
Works at the end of the montEVear) 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 


Authorized Level set by Comptroller 


involved in the measure and units 


Used Current staffing level 
Units - Number of employees 


Sources of data 


Comptroller, In-house records 


Data presentation method. Chart type, 


Run Chart 


software used 


Excel 


Update cycle 


Monthly update 


Responsibility for data collection, 
plotting analysis 


Financial Manager 


Distribution of updated charts 


PW'O/APWO/Shops Engineer/ all divisions in PV\' 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


PWO/APWO Administrative Officer 


Comments and summary; 


Trends clearly show the authorized end strength and 
amount used to date Multiple years indicate down 
sizing over the past vears 
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End Strength Utilization 




End Strength 



Aug*97 

Jun-97 

Apr-97 

Feb-97 

Dec-96 

Oct-96 

Aug-96 

Jun-96 

Apr-96 

Feb-96 

Dec-95 

Oct-95 

Aug-95 

Jun-95 

Apr-95 

Feb-95 

Dec-94 

Oct-94 

Aug-94 

Jun-94 

Apr-94 

Feb-94 

Dec-93 

Oct-93 
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Figure B1 2 - Example of End Strength Utilization 
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Table B1.3 - Overtime Utilization 



Metric 


Overtime Utilization 


Definition of what is being measured 


Overtime usage at PWD broken into labor 
categories 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


PI-D9 - Budget categories 

Authorized - hours authorized by comptroller 

Used - actual hours used to date 

Norm - target % to date 

Units - hours 


Sources of data 


Comptroller 


Data presentation method. Chart type, 
software used 


Histogram with line indicating upper limits 
Excel 


Update cycle 


Monthly update 


Responsibility for data collection, 
plotting analysis 


Financial Manager 


Distribution of updated charts 


PWO/APWO/Shops Engineer/ all di\ isions in P\\’ 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Division directors 


Comments and summary: 


Individual labor categories are broken out The 
norm® 0 indicates the target amount for the year to 
date 
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Overtime Utilization FY97 
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Figure B1 3 - Example of Overtime Utilization 
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Table B1.4 - Toll Costs 



Metric 


Toll Costs 


Definition of what is being measured 


Long distance telephone call use 


Justification for the measurement. Key 
result areas supported 


Cost Management 


Description. Definition of all terms 
involved in the measure and units 


Ceiling - $S authorized 

Lsed - actual $$ used to date 

Authorization - Total SS authorized for P\V 

Actual cost FYTD - $S used to date 

Norm - scheduled target 

Used - % used to date 

Units - $$ 


Sources of data 


NCTS Telephone branch 


Data presentation method. Chart type, 
software used 


Histogram with line indicating upper limits 
Excel 


Update cycle 


Monthly update 


Responsibility for data collection, 
plotting analysis 


Financial Manager 


Distribution of updated charts 


PWO/APWO^Shops Engineer/ all divisions in P\\' 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


All division directors 


Comments and summary: 


Tracking of PVVT) long distance calls by division 
Percentage on top of graph shows each division's 
percentage of total PVVT) costs Norm % indicates 
the target amount for year to date 
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Figure B1 4 - Example of Long Distance Usage 






Table B1.5 - OPTAR PI Tracking 



Metric 


OPTAR PI Tracking 


Definition of what is being measured 


Tracking of OPTAR PI for PVVD 


Justification for the measurement. Key 
result areas supported 


Cost Management 


Description. Definition of all terms 
involved in the measure and units 


OPTAR - Operation Target 
PI - PVV budget for other engineering support 
Authorization - Amount set by Comptroller 
Committed - S$ spent by PW 


Sources of data 


Comptroller 


Data presentation method. Chart type, 
software used 


Run Chaa 
Excel 


Update cycle 


MonthK update 


Responsibility for data collection, 
plotting analysis 


Financial Manager 


Distribution of updated charts 


PWO APWO/ Shops Engineer/ all divisions in PW 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


PVVO/APW'O/ Administrative Officer 


Comments and summary: 


Authorized money doesn't arrive in a linear fashion 
The authorization line shows the trend of money 
being delayed until the third and fourth quarter 
Tracking the committed funds shows the o\ er or 
under obligation 
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Figure B1 5 - Example of OPTAR Tracking for P1 Budget 



Appendix B2 - Facilities Management Engineering Metrics 
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Table B2.1 - Long Range Maintenance Plan ln\estment Categories 



Metric 


Long Range Maintenance Plan 
Investment Categories 


Definition of what is being measured 


Number of hours devoted to Navy's investment 
categories 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


IC - Investment category' code 

Hours - number of hours dedicated to maintenance 

and repair 

Units - Work hours 


Sources of data 


Comptroller, In-house records 


Data presentation method. Chart type, 
software used 


Histogram grouped by IC 
Excel 


Update cycle 


Annual update 


Responsibility for data collection, 
plotting analysis 


602 A 


Distribution of updated charts 


PW’O APW’O' Shops Engineer/ all divisions in P\\' 
P\V Customers 


Highest level of review 


PW^O 


Who is responsible for taking 
necessary control action 


PWO APWO/Facilities Management Engineering 
Director 


Comments and summary: 
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Figure B2.1 - Long Range Plan categorized by Investment Categories 
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Table B2.2 - Long Range Maintenance Plan Base customers 



Metric 


Long Range Maintenance Plan 
Base customers 


Definition of what is being measured 


Number of hours devoted to Base customers 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description, Definition of all terms 
involved in the measure and units 


Customers - Commands and NAS departments 

which receiv e services from PW 

Hours - number of hours dedicated to maintenance 

and repair 

Units - Work hours 


Sources of data 


Comptroller, In-house records 


Data presentation method Chart type, 
software used 


Histogram grouped by customer 
Excel 


Update cycle 


Annual update 


Responsibility for data collection, 
plotting analysis 


6o:a 


Distribution of updated charts 


PWOAAPWO Shops Engineer^ all divisions in PW 
PW Customers 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


PWO^APWO/ Facilities Management Engineering 
Director 


Comments and summary; 
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Long Range Plan By Customer Codes 
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Figure B2 2 - Long Range Plan categorized by Customer Codes 
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Table B2.3 - Causes of Dela\ (\ ariance) 



Metric 


Causes of Delay (Variance) 


Definition of what is being measured 


Summar>' of Delays from Shop Load plan work 
schedule 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Causes of Delay 
W - weather 

L - labor availability (lack of) 
M “ material 

U - unforeseen conditions 
S - customer change in scope 
C - customer caused delay 
0 - other 


Sources of data 


Shop Load plan and Production Controller 


Data presentation method. Chart type, 
software used 


Histogram 

Excel 


Update cycle 


Monthly (discuss at variance meeting) 


Responsibility for data collection, 
plotting analysis 


Production Controller, 602 A 


Distribution of updated charts 


PWO/APWO Shops Engineer/ Facilities 
Management Engineering Director, Maintenance 
Division Director 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Shops Engineer, Facilities Management Engineering 
Director, Maintenance Division Director 


Comments and summary: 


hypothetical data - actual not ax ailable 
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Figure B2 3 - Example of Causes of Delay Analysis 



Appendix B3 • Engineering Metrics 
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Table B3.1 - Engineering Design 



Metric 


Engineering Design 


Definition of what is being measured 


PW Engineering design etTiciency 


Justification for the measurement. Key 
result areas supported 


Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Design S$ - estimated construction costs to 
construct the project Hours and costs for the 
design effort are accounted separately 

Design and Tech hours - work hours by engineers 
and technicians on projects 

Units - (S$ Cost Estimated) / (Design ^ Tech hours) 


Sources of data 


In-house records 


Data presentation method. Chart type, 
software used 


Run Chan (Control Chan later) 
Excel 


Update cycle 


Quanerly update 


Responsibility for data collection, 
plotting analysis 


Engineering Division Director 


Distribution of updated charts 


PWO APWO / Engineering Div ision Director 


Highest level of review 


PW'O ! APWO / Engineering Division Director 


Who is responsible for taking 
necessary control action 


Engineering Division Director 


Comments and summary: 


Units show Ratio of Cost Estimated $$ to design 
hours. Higher numbers reflect better efficiency (i e 
more design for less work hours) 

If this ratio is ambiguous, develop another, but make 
sure the figures include efficiency and not simply 
workload measurements 




hypothetical data - actual not available 



57 



Engineering Design Efficiency 
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Figure B3 1 - Example of Engineering Design Efficiency 
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Appendix B4 - Planning Metrics 
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Table B4.1 - Special Project Documentation 



Metric 


Special Project Documentation 


Definition of what is being measured 


Completion of special project documentation 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Number of projects - Special project packages 
completed during Fiscal year 
Hours - total hours spent on projects 
Units - each package 


Sources of data 


In-house records 


Data presentation method. Chart type, 
software used 


Control Chart 
Excel 


Update cycle 


Annual update 


Responsibility for data collection, 
plotting analysis 


Planning Division Director 


Distribution of updated charts 


PWO / APWO / Facilities Management Engineering 
Director / Engineering Division Director / 
CINCLANTFLT 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Planning Di\ ision Director 


Comments and summary: 


Current trend measures output from division 
(Workload measurement) Recommend changing to 
efficiency measurement by calculating 




ti estimates/total hours worked on estimates 




1 

hypothetical data - actual not available 
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Special Project Documentation Efficiency 
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Figure B4.1 - Example of Special Project Documentation Efficiency 
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Table B4.2 - Space Utilization 



Metric 


Space Utilization 


Definition of what is being measured 


Tracking of relocation and space requests by base 
commands and departments 


Justification for the measurement. Key 
result areas supported 


Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 




Sources of data 


Existing database 


Data presentation method. Chart type, 
software used 


Currently no method 


Update cycle 


As-necessar> (at least quarterly) 


Responsibility for data collection, 
plotting analysis 


Planning Division Director 


Distribution of updated charts 


NAS Executive Officer, PWO, APWO. Planning 
Division Director 


Highest level of review 


NAS Executive Officer 


Who is responsible for taking 
necessary control action 


NAS Executive Officer, PWO, Planning Division 
Director 


Comments and summary; 


Space utilization report is generated after each 
utilization meeting Listed are requests granted, put 
on hold, and rejected Compile the actions into 
groups by command 
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Table B5.1 - Shop Loading Predictability 



Metric 


Shop Loading Predictability 


Definition of what is being measured 


Predictability of Shop Load Plan actually worked 
based on the level of loading 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Shop loading ° b - percentage of total estimated 
available work hours for the month 
% Worked - percentage of shop loaded hours 
worked for the month 


Sources of data 


Shop Load Plan, labor distribution cards 


Data presentation method. Chart type, 
software used 


Scatter diagram 
Excel 


Update cycle 


Quarterly 


Responsibility for data collection, 
plotting analysis 


Maintenance Division Director, Production 
Controller 


Distribution of updated charts 


PWO ' APWO / Shops Engineer / Facilities 
Management Engineering Director 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Shops Engineer, Maintenance Division Director, 
Facilities Management Engineering Director 


Comments and summary: 


Scatter plot indicates that the more the plan is 
loaded to maximum, the less like the chance of 
having it worked to the maximum is Continue to 
collect data to determine stronger correlation 
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Shop Loading Predictability 
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Figure B5 1 - Example of Scatter Plot for Shop Load Plan Predictability 
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Table B5.2 - Priorit\ Job Impact 



Metric 


Priority Job Impact 


Definition of what is being measured 


Delays in original shop load plan due to unforeseen 
priority jobs 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Priority Jobs - Commanding Officer interest jobs. 
Other requests from Higher HQ. Storm damage or 
other jobs requiring immediate attention 
Units - Work hours 


Sources of data 


605 A labor distribution and time cards 


Data presentation method. Chart type, 
software used 


Control Chart 
Excel 


Update cycle 


Monthly 


Responsibility for data collection, 
plotting analysis 


Maintenance Division Director. Production 
Controller 


Distribution of updated charts 


PWO / APWO ' Shops Engineer / Facilities 
Management Engineering Director 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


PWO, Shops Engineer, Maintenance Division 
Director 


Comments and summary: 


Average hours spent on priority jobs must be figured 
into the shop load plan estimate Ignoring this 
amount of hours will only lead to failure in meeting 
the shop load plan 
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Priority Job Impact on Shop Load Plan 
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Figure B5.2 - Example of Impact of Priority Jobs on Shop Load Plan 
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Table B5.3 - Effect of Leave Planning on Shop Load Plan 



Metric 


Effect of Leave Planning on Shop 
Load Plan 


Definition of what is being measured 


Planned leave hours v actual leave hour 


Justification for the measurement. Key 
result areas supported 


Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Work hours - includes annual, emergency and sick 
leave 

Planned - estimated leave hours 
Actual - actual leave hours used 


Sources of data 


Time cards, labor distribution cards 


Data presentation method. Chart type, 
software used 


Run Chart, Control Chart 
Excel 


Update cycle 


Monthly update 


Responsibility for data collection, 
plotting analysis 


Production Controller 


Distribution of updated charts 


PWO/APWO/Shops Engineer/ Facilities 
Management Engineering Director 


Highest level of review 


Shops Engineer 


Who is responsible for taking 
necessary control action 


Shops Engineer, Maintenance Division Director 


Comments and summary: 


Ratio doesn't indicate actual -+*/- hours Ratio 
greater than 1 indicates less leave taken than 
planned, less than 1 indicates more leave taken than 
planned More leave taken than planned means less 
hours available for the shop load plan 



68 



Effect of Leave Planning on Shop Load Plan 
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Figure B5 3 - Example of Leave Predictability 



Table B5.4 - In-House EfTicienc> 



Metric 


In-House Efficienc\ 


Definition of what is being measured 


Efficiency of in-house shop forces on maintenance 
projects 


Justification for the measurement. Key 
result areas supported 


Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Efficiency; 

actual hours - esl hours 

1 *100 

V est. hours J 


Sources of data 


Labor cards and shop load plan 


Data presentation method. Chart type, 
software used 


Control Chart 
Excel 


Update cycle 


Monthly 


Responsibility for data collection, 
plotting analysis 


Maintenance Division Director. Production 
Controller 


Distribution of updated charts 


PWO APWO/Shops Engineer/ Facilities 
Management Engineering Director 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Shops Engineer. Maintenance Division Director 


Comments and summary: 


Weakness arises when original estimate is 
inaccurate Review amendment process Too many 
times the estimator just increases the authorized 
hours to reflect the actual hours spent on the job 
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Figure B5 4 - Example of In-House Shop Forces Efficency 
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Table B5.5 - \V ork Delays 



Metric 


Work Delays 


Definition of what is being measured 


Identiiying causes of delay for shop forces 


Justification for the measurement. Key 
result areas supported 


Cost Management and Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Work hours - time spent on the job 


Sources of data 


Shop Work forces, foremen complete sur\ ey 


Data presentation method Chart type, 
software used 


Histogram 

Excel 


Update cycle 


Quarterly 


Responsibility for data collection, 
plotting analysis 


Maintenance Division Director. Production 
Controller, Facilities Maintenance Super\'isor 
(General Foreman) 


Distribution of updated charts 


PWO / APWO / Shops Engineer / Facilities 
Management Engineering Director / Engineering 
Division Director 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Shops Engineer. Maintenance Division Director 


Comments and summary: 


Foremen complete sur\'ey o\ er a pre-determined 
time period (1 day/week) or (1 week, month) 
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FOREMAN DELAY SURVEY 



Date Craft: Foreman's Name 

Number in shop; 



Delay Causes 


Number of Hours 
Delayed 


Number of Workers 


Work hours 
Delayed 


1 Waiting for materials (warehouse) 








2 Waiting for materials (off site) 








3 Waiting for tools 








4 Waiting for equipment 








5 Re-work (design changes or errors) 








6 Re-work (prefabrication errors) 








7 Re-work (field errors) 








8 Moving to other areas 








9, Waiting for information 








10 Waiting for work or flame permits 








1 1 Waiting on contractor 








12 Interference with other contractors 
crews 








13 Other (Specif\ ) 








14 Comments 





Figure B5 5 - Foreman Delay Data Collection Sheet 
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Table B5.6 - Sen ice Call Completion 



Metric 


Service Call Completion 


Definition of what is being measured 


Average completion time of ser\*ice calls 


Justification for the measurement. Key 
result areas supported 


Resource utilization 


Description. Definition of all terms 
involved in the measure and units 


Completion Time - average time for serv'ice call 
completion. 

Units - days 


Sources of data 


PWT) Database (ECMS'^'’) 


Data presentation method. Chart type, 
software used 


Run Chart. Control Chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Production Controller 


Distribution of updated charts 


Shops Engineer, Maintenance Division Director, 
E&S Shops 


Highest level of review 


Shops Engineer 


Who is responsible for taking 
necessary control action 


Shops Engineer. Maintenance Division Director 


Comments and summary: 


Tracking of ser\ice call completion time provides 
information to the customer as to when the> can 
reasonably expect their call to be completed 
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Figure B5.6 - Example of Service Call Completion Time 



Table B5.7 - Sen ice Call Backlog 



Metric 


Service Call Backlog 


Definition of what is being measured 


Measure of Backlog the PWD Service calls 


Justification for the measurement. Key 
result areas supported 


Resource utilization 


Description. Definition of all terms 
involved in the measure and units 


Backlog indicates outstanding service calls that are 
scheduled for completion by the Emergency Services 
Section of PWD 


Sources of data 


PWT) Database (ESMS'’) 


Data presentation method. Chart type, 
software used 


Histogram (grouped into trades) 


Update cycle 


Weekly 


Responsibility for data collection, 
plotting analysis 


Production Controller 


Distribution of updated charts 


Shops Engineer, shops 


Highest level of review 


Shops Engineer 


Who is responsible for taking 
necessary control action 


Shops Engineer, Maintenance Division Director 


Comments and summary: 


Breakdown by trades will alert foreman to possibilitv 
of process going out of control Service calls out of 
scope requiring planning and estimating are removed 
from E/S and transferred to maintenance backlog 




hypothetical data - actual not available 
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Backlog of Service Calls for E&S Section 
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Figure B5 7 - Example of Backlog for Routine Service Calls 
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Table B5.8 - Jobs using MS Project 



Metric 


Jobs using MS Project 


Definition of what is being measured 


Measurement of PWD Jobs using MS Project to 
track and schedule 


Justification for the measurement. Key 
result areas supported 


Resource utilization 


Description. Definition of all terms 
involved in the measure and units 


Units - Number of jobs using MS Project to track 
and schedule work during the current month 


Sources of data 


Shops 


Data presentation method. Chart type, 
software used 


Run Chart 


Update cycle 


Monthly 


Responsibility for data collection, 
plotting analysis 


Production Controller 


Distribution of updated charts 


Shops Engineer, Maintenance Division Director 


Highest level of review 


Shops Engineer 


Who is responsible for taking 
necessary control action 


Shops Engineer, Maintenance Division Director 


Comments and summary; 


Tracking of actual jobs using MS Project should 
show trend over time of increased use of scheduling 
techniques 




hypothetical data - actual not available 
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Figure B5.8 - Tracking of Jobs using MS Project for Scheduling 
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Appendix B6 - Utilities Metrics 
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Table B6.1 - Electricity Use 



Metric 


Electricity Use 


Definition of what is being measured 


Average Daily use of electricity on base 


Justification for the measurement. Key 
result areas supported 


Cost management & Resource utilization 


Description. Definition of all terms 
involved in the measure and units 


Daily KWH Used - Average of monthly usage to 
show a better representation due to unequal days of 
the month 


Sources of data 


Base power plant and billings from suppliers 


Data presentation method. Chart type, 
software used 


Run Chart, Control Chart 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Utilities Division Director 


Distribution of updated charts 


Shops Engineer. Utilities Division Director. White 
Falcon 


Highest level of review 


Utilities Division Director 


Who is responsible for taking 
necessary control action 


Utilities Division Director 


Comments and summary: 


Tracking and reporting to the base users through 
base wide media (White Falcon. Newsline) on a 
monthly basis will provide feedback as to how the 
base is doing in conserving electricity Informative, 
brief articles accompanying the graphs as to how the 
residents can help conserve energy will provide 
additional impact 
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Electricity Use at NAS Keflavik 
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Figure B6.1 - Example of Electricity Use 



Table B6.2 - Water l^se 



Metric 


Water Use 


Definition of what is being measured 


Amount of water used by base 


Justification for the measurement. Key 
result areas supported 


Resource utilization 


Description. Definition of all terms 
involved in the measure and units 


Units - millions of gallons 


Sources of data 


Base Water Plant - readings taken on a daily basis 


Data presentation method. Chart type, 
software used 


Run Chart, Control Chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Utilities Disision Director, Water Plant Superv isor 


Distribution of updated charts 


Shops Engineer, Utilities Division Director, White 
Falcon 

P\\ 0, APW'O 


Highest level of review 


Utilities Division Director 


Who is responsible for taking 
necessary control action 


Utilities Division Director 


Comments and summary: 


Under the current water contract, the base receives 
the water free of charge This will change under the 
new contract Tracking and reporting to the base 
users through base wide media (White Falcon. 
Newsline) on a monthly basis will provide feedback 
as to how the base is doing in conserving water 
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Water Usage at NAS Keflavik 
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Figure B6 2 - Example of Water Use 
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Table B6.3 - Geothermal Heating 



Metric 


Geothermal Heating 


Definition of what is being measured 


Heating water flovs into the base 


Justification for the measurement. Key 
result areas supported 


Resource utilization 


Description. Definition of all terms 
involved in the measure and units 


Liters/minute - total liters per minute flowing into 
the base 

Units - Liters/minute 


Sources of data 


Bills from suppliers (Sudenes Regional Heating 
Authority) 


Data presentation method. Chart type, 
software used 


Run Chart 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Utilities Division Director, Management and Budget 
Technician 


Distribution of updated charts 


PWO. APWO. Shops Engineer, Utilities Division 
Director 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Utilities Division Director 


Comments and summary: 


This measurement is mainly for reviewing past 
information Flow s are controlled by PW and the 
geothermal contract 
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Figure B6.3 - Example of Geothermal Usage at NAS Keflavik 
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Appendix B7 • Transportation Metrics 
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Table B7.1 - Vehicle Down-time 



Metric 


Vehicle Availability 


Definition of what is being measured 


Average Monthly Percentage of Class C' vehicle 
availability 


Justification for the measurement. Key 
result areas supported 


Customers, Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Availability - vehicle is in operating condition 


Sources of data 


PC Transport Database 


Data presentation method. Chart type, 
software used 


Run Chart, control chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Transportation Officer 


Distribution of updated charts 


PWO, APWO, Transportation Officer 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Transportation Officer 


Comments and summary; 


Develop criteria for availability that is meaningful for 
both PW and customers 




hypothetical data - actual not available 
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Figure B7.1 - Example of Class 'C Vehicle Availability 



Table B7.2 - N’ehicle Turn-Around Time 



Metric 


Vehicle Turn-Around Time 


Definition of what is being measured 


Average time for completion of repairs to vehicles 


Justification for the measurement. Key 
result areas supported 


Customers, Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Repair Time - Number of days from time vehicle is 
delivered to PW until time it is returned to the 
customer. 


Sources of data 


PC Transport Database 


Data presentation method. Chart type, 
software used 


Run Chart, control chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Transportation Officer 


Distribution of updated charts 


PVVO, APWO, Transportation Officer 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Transportation Officer 


Comments and summary: 


hypothetical data - actual not available 
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Figure B7.2 - Example of Vehicle Turn-Around Time 
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Appendix B8 - Contracts Metrics 
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Table B8.1 ~ Invoice Turn-Around Time 



Metric 


Invoice Turn-Around Time 


Definition of what is being measured 


Average time for Contracts Division to process 
contractor's invoice 


Justification for the measurement. Key 
result areas supported 


Cost management 


Description. Definition of all terms 
involved in the measure and units 


Invoice Time - Number of days from time Contracts 
receives invoice until time processing is complete 


Sources of data 


Procurement records 


Data presentation method. Chart type, 
software used 


Run Chart, control chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Procurement Clerks, Contract Specialists 


Distribution of updated charts 


PWO. APWO, Contracts Division Director 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Contracts Division Director 


Comments and summary: 


hypothetical data - actual not available 
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Figure B8 1 - Control Chart Tracking Processing Times for Contractor's Invoices 



Table B8.2 - Contractor Performance Evaluation 



Metric 


Contractor Perfonnance Evaluation 


Definition of what is being measured 


Annual performance ofSerx ice Contractors 


Justification for the measurement. Key 
result areas supported 


Customer 


Description. Definition of all terms 
involved in the measure and units 




Sources of data 


Contract files 


Data presentation method. Chart type, 


Histogram, 


software used 


Excel 


Update cycle 


.Annual Update 


Responsibility for data collection, 
plotting analysis 


Contract Specialist, FSCM 


Distribution of updated charts 


PWO, APWO, Contracts Division Director 


Highest level of review 


PVVO 


Who is responsible for taking 
necessary control action 


Contracts Di\ ision Director 


Comments and summary: 
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Table B8.3 - Customer Satisfaction 



Metric 


Customer Satisfaction 


Definition of what is being measured 


Satisfaction of Base Customers on the services they 
receive from the contractors 


Justification for the measurement. Key 
result areas supported 


Customers 


Description. Definition of all terms 
involved in the measure and units 




Sources of data 


inspection Surveys 


Data presentation method. Chart type, 
software used 


Histogram, Paraedo Chart 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


FSCM 


Distribution of updated charts 


PW 0. APW'O, Contracts Division Director 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


FSCM 


Comments and summary; 


Develop a short series of questions to ask random 
customers about the service the>' receive from 
contracted work Compile the information into a 
meaningful presentation. 
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Table B8.4 - Procurement Action Lead Time 



Metric 


Procurement Action Lead Time 


Definition of what is being measured 


Comparison of Actual Procurement Actions with 
scheduled actions 


Justification for the measurement. Key 
result areas supported 


Customers, Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Scheduled Time - Estimated Time of action 
Actual Time - Actual completion date 


Sources of data 


Contract Database 


Data presentation method. Chart type, 
software used 


Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


Contracting Officer, Contract Specialist, 
Procurement Clerk 


Distribution of updated charts 


PWO, APWO. Contracts Division Director 


Highest level of review 


OIC 


Who is responsible for taking 
necessary control action 


Contracting Officer 


Comments and summary: 
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Appendix B9 • Environmental Metrics 
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Table B9.1 - Hazardous Waste Pick-l p 



Metric 


Hazardous Waste Pick-Up 


Definition of what is being measured 


Response time to pick up hazardous waste 

t 


Justification for the measurement. Key 
result areas supported 


Safety, Customer 


Description. Definition of all terms 
involved in the measure and units 


Response Time - Length of time from receiving 
initial request to time waste is picked up 


Sources of data 


Environmental Records 


Data presentation method. Chart type, 
software used 


Run Chart, control chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


60E 1 1 Hazardous Waste Services 


Distribution of updated charts 


PWO, APWO. Environmental Officer 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Environmental Officer 


Comments and summary: 


hypothetical data - actual not available 
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Figure B9 1 - Example of Hazardous Waste Pick Up Response Time 
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Table B9.2 - Spill Response Time 



Metric 


Spill Response Time 


Definition of what is being measured 


Response time for hazardous waste spills 


Justification for the measurement. Key 
result areas supported 


Safety, Customers 


Description. Definition of all terms 
involved in the measure and units 


Response Time - Length of time from receiving 
initial notification to time on site 


Sources of data 


Environmental Records 


Data presentation method. Chart type, 
software used 


Run Chart, control chart (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


60E 1 1 Environmental Support Services 


Distribution of updated charts 


PWO. APWO, Environmental Officer 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Environmental Officer 


Comments and summary: 


hypothetical data - actual not available 
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Figure B9.2 - Example of Spill Response Time 
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Table B9.3 - Construction Re\ iew 



Metric 


Construction Review 


Definition of what is being measured 


Number of construction review s performed by 
Environmental Division and average time for review 


Justification for the measurement. Key 
result areas supported 


Safety, Resource Utilization 


Description. Definition of all terms 
involved in the measure and units 


Review Time - Length of time from receiving initial 
request to time construction review is completed 


Sources of data 


Internal record tracking 


Data presentation method. Chart type, 
software used 


Run Chan, control chan (later) 
Excel 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


60E2 and 60E3, Environmental Engineers 


Distribution of updated charts 


PWO, APW'O. En\ ironmental Officer 


Highest level of review 


PW'O 


Who is responsible for taking 
necessary control action 


Environmental Officer 


Comments and summary: 


hypothetical data - actual not available 
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Figure B9 3 - Example of Construction Review Measurements 



Table B9.4 - W ater Quality 



Metric 


Water Quality 


Definition of what is being measured 


Consistency of Water Quality at \AS Keflavik 


Justification for the measurement. Key 
result areas supported 


Safety 


Description. Definition of all terms 
involved in the measure and units 




Sources of data 


Environmental Records 


Data presentation method. Chart type, 
software used 


Histogram 

Excel 

(RuaControl chart if data is quantifiable) 


Update cycle 


Monthly Update 


Responsibility for data collection, 
plotting analysis 


60E3, Environmental Engineer (Water Resources 
Program Director) 


Distribution of updated charts 


PV\'0, APWO, Environmental Officer 


Highest level of review 


PWO 


Who is responsible for taking 
necessary control action 


Environmental Officer 


Comments and summary: 


No chart developed yet — determine the best type 
based on data collection 
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Appendix C - List of Acronyms 



Acronym 


Description 


AIS 

APWO 

CINCLANTFLT 

DON 

FMED 

FSC 

FSCM 

HRO 

LANTDIV 

NAS 

NAVFAC 

OPTAR 

P&E 

PWD 

PWO 

SIPOC 

SJO 

TQL 

TQM 


Annual Inspection Summary 
Assistant Public Works Officer 
Commander-In-Chief, Atlantic Fleet 
Department of Navy 

Facilities Management Engineering Division 
Facilities Support Contracts 
Facilities Support Contract Manager 
Human Resources Office 
Atlantic Division of NAVFAC 
Naval Air Station 

Naval Facilities Engineering Command 
Operation Target (Budget Goal) 

Planning & Estimating 

Public Works Department 

Public Works Officer 

Supply-Input-Process-Output-Customer 

Standing Job Order 

Total Quality Leadership 

Total Quality Management 
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